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Abstract — Kudekar et al. proved that the beUef-propagation 
(BP) threshold for low-density parity-check codes can be boosted 
up to the maximum-a-posteriori (MAP) threshold by spatial 
coupling. In this paper, spatial coupling is applied to randomly- 
spread code-division multiple-access (CDMA) systems in order 
to improve the performance of BP-based multiuser detection 
(MUD). Spatially-coupled CDMA systems can be regarded as 
multi-code CDMA systems with two transmission phases. The 
large-system analysis shows that spatial coupling can improve 
the BP performance, while there is a gap between the BP 
performance and the individually-optimal (lO) performance. 

I. Introduction 

The belief-propagation (BP) threshold of a low-density 
parity-check (LDPC) convolutional code [JJ has been shown 
to coincide with the maximum-a-posteriori (MAP) threshold 
of the coiTesponding LDPC block code f2\, (?]. Since LDPC 
convolutional codes can be regarded as a spatially-coupled 
chain of LDPC block codes, this phenomenon is referred to 
as threshold saturation via spatial coupling (2\. 

Recently, we proposed a phenomenological model for ex- 
plaining this phenomenon ID . In the phenomenological study, 
spatial coupling is regarded as a general method for conveying 
an suboptimal solution to the optimal solution. In this paper, 
we apply the principle of spatial coupling to code-division 
multiple-access (CDMA) systems in order to improve the 
performance of BP-based multiuser detection (MUD). 

It is important in CDMA systems to mitigate multiple- 
access interference (MAI), by using MUD f5 1. Let us consider 
conventional K-nser randomly-spread CDMA systems with 
spreading factor N. Tanaka ||6| used the replica method to 
analyze the performance of the optimal MUD, called the 
individually-optimal (lO) receiver [5|, in the large-system 
limit, where K and N tend to infinity while the system load 
/3 — K/N is kept constant. For f3 < /?io, with /3io denoting 
a critical system load, the mean-squared error (MSE) for soft- 
decisions of the lO receiver takes a small value. Thus, the 
lO receiver can mitigate MAI successfully for f3 < /3io- For 
/? > /3io, on the other hand, the MSE for the 10 receiver takes 
a large value. This result implies that MAI cannot be mitigated 
for f3 > f3io- Thus, /3io can be regarded as a threshold between 
the MAI-limited region and the non-limited region. Since the 
system load /3 is proportional to the sum rate, the lO threshold 
Pio provides a performance index for the lO receiver 
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Fig. 1. Typical landscape of free energy as a function of MSE. (a) /3 G 
(/3bPi/3io)- (b) /3 > fto- The large (small) balls represent the solutions for 
the BP-based receiver (the 10 receiver). 



The computational complexity of the lO receiver grows 
exponentially in the number of users. Kabashima |7| proposed 
a low-complexity iterative MUD algorithm based on BP. It 
was shown numerically that the algorithm converges for large 
systems. Furthermore, the BP-based receiver for large systems 
can achieve the MSE of the lO receiver for /3 < Pbp, with a 
system load /?bp(< Ao). while the MSE takes a larger value 
for /3 > Pbp- Thus, the BP threshold /3bp can be regarded as 
another critical threshold between the MAI-limited and non- 
limited regions for the BP-based receiver. See |j8], ||9] for a 
rigorous treatment based on sparsely-spread CDMA systems. 

What is occurring for (3 between (3bp and /3io? The MSE 
for the lO receiver is given by the global stable solution of 
a potential energy function, called free energy 0. On the 
other hand, the MSE for the BP-based receiver is given by 
the stable solution of the free energy corresponding to the 
largest MSE [71 (See also fM Fig. 2(a)]). This solution is 
metastable for (3 E {Pbp, f^io)^ as shown in Fig.[Tfa), while it 
is the global stable solution for (3 > (3io- Thus, the MSE for 
the BP-based receiver is trapped in a metastable solution for 
/3 £ (/3bp, Ao). while the MSE for the 10 receiver approaches 
the global stable solution. 

Instead of constructing a BP-based receiver for spatially- 
coupled CDMA systems, in this paper, we derive the BP 
fixed-point equation, characterizing the performance of the 
BP-based receiver after sufficiently many iterations, by using 
the replica method. We will show that the MSE for BP-based 



receivers can be brought to the global stable solution of an 
effective potential energy function by spatial coupling, i.e., 
the BP threshold is boosted up to a threshold. Unfortunately, 
the threshold does not coincide with the lO threshold, because 
the potential energy is different from the free energy for con- 
ventional CDMA systems. The rest of this paper is organized 
as follows: In Section we review our phenomenological 
study f4l. In Section Hill we define spatially-coupled CDMA 
systems. Section |IV] presents a large-system analysis of the 
spatially-coupled CDMA systems. In Section [V] we show that 
spatial coupling can improve the performance of BP-based 
MUD. Section [Vll concludes this paper 

II. A Phenomenological Study 

Density evolution (DE) is a powerful method for ana- 
lyzing the performance of BP-based algorithms for graphi- 
cal models [11]. In the BP-based algorithms, messages are 
iteratively exchanged between variable nodes and function 
nodes on the factor graph. The densities of the messages are 
characterized by a few macroscopic parameters, such as the 
average error probability for LDPC codes over binary erasure 
channel (BEC) [2| or the MSE for conventional CDMA 
systems [9|. DE is a method for deriving a closed-form time- 
evolution equation for the macroscopic parameters, called the 
DE equation. For simplicity, we consider the case in which 
each density is described by one macroscopic parameter 

Let us consider a spatial coupling of L subsystems. The 
densities of the messages for the spatially-coupled system 
in iteration i are characterized by macroscopic parameters 
{yi{x ~ ^/L)} at spatial positions / = 0, — 1. We 

assume that the DE equation for the macroscopic parameters 
in L — > oo is given by a dynamical system on a: G [0,1] with 
a small diffusion coefficient < £> <C 1, 

dU cPyt 
yi+i{x) -yt{x) = ~-^{yt{x);f3) +D-^, (1) 

with U{y; (3) denoting a potential energy function, in which f3 
is a parameter characterizing the subsystem, such as the system 
load for CDMA systems. The potential energy is assumed 
to have two stable solutions in a region of (3. Note that the 
potential energy depends on the position x only through yi{x). 

Let 2/min denote the global stable solution of the potential 
energy U{y;(3). We impose the boundary conditions yi{0) = 
yi{l) = ymin- This type of boundary corresponds to termina- 
tion for LDPC convolutional codes. One may expect that the 
information about the global stable solution at the boundaries 
diffuses over the whole system, because the diffusion term in 
([TJ smooths yi{x) spatially. In fact, this intuition is correct. 

Theorem 1 (Takeuchi et al. H). Suppose that yi{x) converges 
to a stationary solution y{x) in i ^ oo, satisfying 

If ymin is the unique minimizer of the potential energy U (y; 
then, the uniform solution y{x) — T/min is the unique stationary 
solution to (|7}. 



What occurs when the boundaries are fixed to a metastable 
solution of the potential energy U{y\f3)l Numerical simula- 
tions |4| imply that yi{x) converges to a spatially-nonuniform 
stationary solution for sufficiently small D > Q. Let us define 
the BP threshold fi^p^ for the spatially-coupled system as 
the supremum of /3 such that yi{x) converges to the uniform 
solution y{x) — y^m in i — cx). Theorem [T] and the 
observation described just above imply that /3gp is given 
by the point /3 at which the potential energy U{y\ (3) at one 
stable solution y — ymin is equal to that at the other stable 
solution y ^ y^hi, i.e., C/(y,„i„; /3^p^^) = C/(yi„i„; /3^p^^). 

III. System Models 

A. Spatially-Coupled CDMA Systems 

We consider a /iT-user spatially-coupled CDMA system with 
variable spreading factor. Let Nt and L denote the spreading 
factor in symbol period t and the number of symbol periods 
per transmission block, respectively. The vector Uk^t G C^' 
transmitted by user k in symbol period t is given by 

Uk,t ^ —7=y^htjs[''^bk.i for t = 0, . . . ,i - 1, (3) 

^ ' (=0 

where b^j G C denotes the Ith data symbol for user k with unit 
power E[|6fc_;p] = 1; sf^^ g C^* represents the kh spreading 

sequence for user k in symbol period t with E[||s|'^;''|p] = 
Nt; and htj G C denotes the Ith (deterministic) coupling 
coefficient in symbol period t. For notational convenience, 
we have defined the transmitted vector (|3) as if i different 
spreading sequences are used in each symbol period. However, 
the actual number of spreading sequences is much smaller than 
L, because many coupling coefficients are adjusted to zero, 
as shown in the following examples. Note that the identical 
data symbols bk — (&fc.o, . • ■ , &A:.l-i)^ are transmitted in 
all symbol periods, while different data symbols are sent 
in the conventional multi-code CDMA systems. Under the 
assumption of unfaded channels, the received vector e C^* 
in symbol period t is given by 

K 

yt=^Uk,t+Wt, wt ^ CM {0,(7"^ I Nt)- (4) 
fc=i 

It is straightforward to extend our analysis to the case of fading 
channels |12|. 

For the simplicity of analysis, the data symbols {bkj} 
are assumed to be independent and identically distributed 
(i.i.d.) for all k and I. Furthermore, we assume that the 
spreading sequences {s[''i} are i.i.d. for all k, t, and /, and 

that each spreading sequence s). ( have i.i.d. zero-mean real 
and imaginary parts with variance 1/2. In order to restrict the 
average transmit power E[||u.fc.t|p] to unit power, we impose 
the constraint 'Y^Zq V'-t.i^ — 1- Furthermore, we impose the 
constraint X]f=o^ l'**,'!^ = 1 to equalize the power used for 
transmission of each data symbol. 

Example 1 (Uncoupled System). Let ht.i = Stj and Nt = N. 

The system reduces to the conventional CDMA system. The 



sum rate for quadrature phase shift keying ( QPSK) is given 
by 2/3, with /3 — K/N denoting the system load. 

Example 2 (Circularly-Coupled Systems). The coupling coef- 
ficients far circularly-coupled systems are given by ht^i — ht-i 
for t — I > and ht.i = ht-i+L for t ^ I < 0, with 



1/VW + 1 for t = 0, 







fort^W ^\,...,L-l, 



(5) 



where W -\- \ corresponds to the number per symbol period 
of spreading sequences used by each user One transmission 
block consists of an initialization phase t — 0, . . . ,W — 1 
and a communication phase t — W, . . . , L — I. The spreading 
factor Nt — Ninit in the initialization phase is adjusted to a 
small value, so that the receiver should be able to detect the 
data symbols sent in this phase successfully. The spreading 
factor Nt = N in the communication phase is chosen to a 
large value in order to increase the transmission rate. The 
sum rate R for the circularly-coupled systems with QPSK is 
given by 

2KL 



R= 



iVinitH^ + N{L - W) 
2 

pr^,{W/L) + l3-^{l-{W/L)y 



(6) 



where /3init — K/Ni^a ond /3 — K/N denote the system loads 
in the initialization and communication phases, respectively. 
The system load /3 in the communication phase corresponds to 
the parameter (3 in the dynamical system ([7}. The sum rate 
tends to the sum rate 2/3 for the uncoupled CDMA system 
presented in Example\l\when L tends to infinity with W fixed. 
In other words, the rate loss due to the initialization phase is 
negligible when L is sufficiently large. 

B. 10 Receiver 

There is an interesting connection between the performance 
of BP-based receivers and of the 10 receiver for uncoupled 
CDMA systems, i.e., a fixed-point equation characterizing 
the performance of the lO receiver coincides with the BP 
fixed-point equation obtained from DE |7|-f9l, fl3\. Thus, 
we can predict the BP fixed-point equation by analyzing the 
performance of the lO receiver 

The lO receiver detects the data symbols for each user 
from the received vectors y — {y^ } in all symbol periods. The 
soft decision bkj of the data symbol bkj for the lO receiver 
is given by the posterior mean estimator (PME) 



bkd = ^bkjPbk\y,s{bk\y,S), 



(7) 



where pf,^\y^s{bk\y,S) denotes the posterior distribution of 
bfe given all received vectors 3^ and all spreading sequences 



{s[''i}. It is well-known that the PME achieves the 



S 

minimum mean-squared error (MMSE). 

Remark 1. Let us consider "online" detection for the 
circularly-coupled system with W = I, presented in Exam- 
ple^ The receiver detects the first data symbols {b^.o} and the 



last data symbols {bk,L-i} in the initialization phase. These 
symbols should be detected successfully for sufficiently small 
/3init. In symbol period t — 1, the receiver detects the second 
data symbols {bk,i} from the received vector y^. The known 
MAI due to the first data symbols is first subtracted from y^. 
The obtained vector can be regarded as the received vector 
in symbol period t = 1 for the uncoupled system. However, 
the average transmit power in this case is 1/2, which is half 
the power for the uncoupled system. Thus, this type of online 
detection is suboptimal. 

IV. Large-System Analysis 

In order to analyze the performance of the lO receiver (0, 
we consider the large-system limit in which K and {Nt] tend 
to infinity while L and the system loads (St — K/Nt for all t 
are fixed. We use the replica method to calculate the MSE 
for the lO receiver, following llT2l . The replica method is 
a powerful method for large-system analysis, although it is 
based on several heuristic assumptions 0, lfT4l . The detailed 
calculation is omitted because of space limitation. 

The spatially-coupled CDMA system is decoupled into a 
bank of equivalent single-user channels in the large-system 
limit. This type of decoupling was originally shown for 
the conventional CDMA systems fT?). We first define the 
equivalent single-user channels for user k. The received signals 
for the single-user channels are given by 



(k) 



ht.ib 



lOkl 



w. 



(fc) 
t.i 



for t = 0, . . . , i - 1, 



(8) 



with w. 



(k) 
t.i 



CAf{0,at). The lO receiver for the single- 
user channels detects the data symbol bkj from the received 
signals Zi'^'' — {z^f : for all t} on the basis of the posterior 
probability ^1^,^, 
for this lO receiver is given by 



(k){bk,i\zl''^). The soft decision {bk,i) of bk,i 



'k,l 



bk.l 



bk,iPu 



Its MSE is given by 



ii^^[\bk,i-{bkM 



(9) 



(10) 



The MSE ( fTOl l depends on {cr^} only through the asymptotic 
signal-to-interference ratio (SIR) for the single-user chan- 
nel (|8j, given by 



(11) 



Thus, we can write ( fTOl i as = ^(sir^"^). The properties 
of MSE imply that the function ^(2;) on z e (0, 00) is a 
monotonically-increasing bounded function. 

We have not so far specified the variances {ctj }. By defining 
the variances as the solution to coupled fixed-point equations, 
the MSE for the spatially-coupled CDMA system is connected 
with that for the decoupled systems. 



Proposition 1. The MSE of the 10 receiver for the spatially- 
coupled CDMA systems converges to that for the single-user 
channels in the large-system limit, i.e., 

n\bk.i-Ki?]^^i for all k. (12) 

In evaluating the right-hand side of f l72l ). the variances {dj} 
are given by the solution to the coupled fixed-point equations, 

L-l 

al = a'' + l3tY,\ht,v\''i{siri,^) for all t, (13) 

where sir/ is given by Mlh If the coupled fixed-point equa- 
tions ( liil ) have multiple solutions, one should choose the 
solution minimizing the so-called free energy, 

F =\^m,,z\''^) + \^Y.Pt'D{aVtl (14) 

where D{a'^\\u^) denotes the Kullback-Leibler divergence 
between C7V(0, cr^) and C7V(0, cr^). 

The free energy (fl4l is a quantity proportional to the 
achievable sum rate I{{bk}]y\S) / (Y^^^^ Nt) in the large- 
system limit. 

In order to obtain an intuitive understanding of the solu- 
tion to (flJl i. we consider the circularly-coupled system with 
Z^init 0, presented in Example |2] It should be possible to de- 
tect the data symbols {bk,i : I — 0, . . . ,W—1,L — W, . . . ,L — 
1} transmitted in the initialization phase without errors. Thus, 
the corresponding boundaries {^j} can be regarded as zero. 
In positions distant from the boundaries, on the other hand, 
the coupled fixed-point equations ( fTsT l can be approximated by 
the phenomenological model Substituting ( fT3T l into (fTTT i 
yields 

a WW 

^ t=o l'=0 

for 1^ < ; < L - 1 - W^, with = ^i+k - ^i- Let y{x) 
denote a smooth function on a; G [0, 1] satisfying y{l/L) — fi 
for / = 0,...,i— 1. Applying the approximation in i — > oqj, 

with y*^*^ = d^y/dx^\x^i/L, we obtain (|2]l with 

„ WW 

^^WTTpySB'-'T- (17) 

^ ' t=0 l'=Q 

u{y; P) = l\c'{y') - - Py')dy', (i8) 

where £,~^{z) denotes the inverse function of £,{z). Thus, the 
argument presented in Section |ll]implies that the BP threshold 
P^p'^ for the circularly-coupled CDMA systems in L ^ oo 
is given by the point /3 at which the potential energy (fTsT l has 

' This approximation was also considered in 1151 . 
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Fig. 2. MSE for Zth data symbol, l/cr^ =9 dB, L = 32, = 1, and 

ftnit = 1.22. 

two global stable solutions. Unfortunately, the potential energy 
is different from the free energy for the uncoupled CDMA 

(SO 

systems. Thus, the BP threshold /3gp does not coincide with 
the 10 threshold /3io for the uncoupled systems at which the 
free energy (fl4] | for the uncoupled systems has two global 
stable solutions. 

V. Comparison of Thresholds 

The fixed-point equation characterizing the performance of 
the 10 receiver for the uncoupled CDMA systems coincides 
with the BP fixed-point equation in the large-system limit, as 
mentioned in Section Illl-BI Let us assume that this statement 
also holds for spatially-coupled CDMA systems, i.e., the 
coupled fixed-point equations (fT3] i are assumed to coincide 
with the BP fixed-point equations. Thus, the performance of 
BP-based receivers is equal to that of the lO receiver if the 
solution to the coupled fixed-point equations ( fTSl l is unique. 
Otherwise, the BP-based receivers are outperformed by the lO 
receiver We hereafter focus on QPSK data symbols. 

We solve the coupled fixed-point equations (fTsl l by succes- 
sive iteration, i.e., 

;'=o \t'=o / 

with crj(O) = crfnif We conjecture from the result for the 
uncoupled CDMA systems ['9'| that ( fT9b with crfj^jj — 00 cor- 
responds to the DE equation for a BP-based receiver in itera- 
tion i. Figure I2] shows the MSEs calculated from the stationary 
solutions to ([Till with crf^jj = 00. When ^ = 1.6550, the 
MSEs take a small value for all /. Furthermore, we confirmed 
that they coincide with those obtained from the stationary 
solution to iT% with af^^^ = 0. Thus, the coupled fixed-point 
equations (fT3] l has the unique solution when /? — 1.6550. 
When P increases slightly, however, a spatially-nonuniform 
stationary solution appears. This stationary solution does not 
coincide with that for cr? = 0. The criterion based on the 



TABLE I 

Numerically-evaluated BP threshold ^g^jF' for 

CIRCULARLY-COUPLED SYSTEMS. 1/(T^ = 10 DB AND ftnit = 0. 





W 







1 


2 


3 


4 




16 


1.7307 


1.8123 


1.8241 


1.8684 


1.9455 


L 


32 


1.7307 


1.8120 


1.8121 


1.8130 


1.8179 




64 


1.7307 


1.8120 


1.8121 


1.8121 


1.8121 



TABLE II 

Comparison of thresholds. L = 32,W = 1, and ftnit = 0. 





/3bp 


Prp 


Prp 


Ao 


Pm 


9 dB 


1.6147 


1.6550 


1.6550 


1.6992 


1.7048 


10 dB 


1.7307 


1.8120 


1.8121 


1.9826 


1.9873 


12 dB 


1.8734 


2.0030 


2.0039 


2.5071 


2.4973 


14 dB 


1.9552 


2.1109 


2.1132 


2.9855 


2.9584 



free energy (fT4l l implies that the spatially-nonuniform solution 
is not the solution corresponding to the lO receiver Thus, the 
BP-based receivers are outperformed by the lO receiver when 

P is strictly larger than the BP threshold = 1.6550. This 

" (so 

numerically-evaluated threshold /3gp = 1.6550 coincides 

(SO 

with the theoretical prediction /3gp = 1.6550 based on the 
effective potential energy ( flSl l. It is worth noting that we chose 
a large system load Pian = 1.22 in the initialization phase. One 
need not adjust the system load in the initialization phase to 
zero. 

Table U lists the numerically-evaluated BP thresholds /Sg^^ 
based on ( fT9] l for several L and W. The thresholds for W = 
correspond to the BP threshold for the uncoupled CDMA 
systems. The BP thresholds for the circularly-coupled CDMA 
systems are always larger than that for the uncoupled CDMA 

systems. The thresholds in right-upper cells on Table |I] are 

(so 

above the theoretical prediction /3gp = 1.8121 based on the 
potential energy (fTsl l. This observation is because the rate loss 
due to the initialization phase is not negligible in the right- 
upper region. Table U implies that W — 1 is the best option 
in terms of the sum rate (|6]l. Note that W may affect the 
convergence property of the BP-based receivers. 

Table mipresents the comparison between several thresholds. 
The thresholds /3bp and /3io denotes the BP and lO thresholds 

for the uncoupled CDMA systems, respectively. The threshold 

" (SO 

/3gp represents the numerically-evaluated BP threshold for 
the circularly-coupled CDMA systems, while l^'^p ^ is its 

theoretical prediction based on the potential energy (fT¥t . We 

(so 

calculated an upper bound of the lO threshold /3jq for the 
circularly-coupled systems from the two stationary solutions to 
(fT9] l with the initial values a?^^f. = oo and crfj^jj — 0. Note that 
the coupled fixed-point equations ( fTsT l have the unique solution 
when the signal-to-noise ratio (SNR) 1/ct^ is below 8.25 dB. 
The theoretical prediction /^g^^ is in good agreement with 
the numerically-evaluated one P^p^ for I/ct^ ^ 9 dB and 
1/^2 = 10 dB. The BP threshold P^^p^ for the circularly- 
coupled CDMA systems are larger than the BP threshold /3bp 

for the uncoupled CDMA systems for all SNRs, while there 

(so 

is a gap between /3gp and the lO threshold /3io- 

VI. Conclusions 

We have proposed the spatially-coupled CDMA systems 
in order to improve the performance of BP-based multiuser 
detection. The large-system analysis shows that the circularly- 
coupled CDMA systems can improve the BP threshold, com- 
pared to the one for the conventional CDMA systems, while 



there is a gap between the improved BP threshold and the 
lO thresholds. We conclude that spatial coupling is a general 
method for boosting the BP threshold for graphical models up 
to a value, although it depends on the models whether or not 
the value coincides with the optimal one. 
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